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(54) Robust features extraction for speech processing 



(57) A speech processing system is provided 

which is operable to receive sets of signal values 
representative of a speech signal generated by a speech 
source as distorted by a transmission channel between 
the speech source and the speech processing system. 
The system stores data defining a predetermined 
function derived from a signal model which models both 
the speech source and the channel and defining a 
probability density function which gives, for a given 
set of model parameters, the probability that the 
signal model has those model parameters given that the 
signal model is assumed to have generated the received 



set of signal values. The system applies a current set 
of received signal values to the stored probability 
density function and then draws samples from it using a 
Gibbs sampler. The system then analyses the samples to 
determine a set of parameter values representative of 
the speech signal before it was distorted by the channel. 

FIG. 2 
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Description 



[0001] The present invention relates to an apparatus for and method of speech processing. The invention 
particularly relates to a statistical processing of an input speech signal to derive parameters defining the speech 
production system which generated the speech. 

[0002] Most speech processing systems, such as speech recognition systems, speech encoding systems, speaker 
verification systems and the like all include a signal processing front end, which converts the speech waveform into 
a parametric representation. One of the most common types of parameters (or coefficients) which are generated to 
represent speech are linear prediction (LP) coefficients. To represent the entire input speech signal, the speech is 
divided into a number of time frames (typically having a duration of 10-30ms) and a set of LP coefficients is 
calculated to represent the speech within each time frame. This LP analysis assumes that the value of a current 
speech sample can be predicted from a linear weighted combination of the k most recent speech samples. Based on 
this model, the task of the LP analysis is to identify the value of the weightings (or coefficients) which minimises 
the mean squared error between the actual value of the current speech sample and the predicted value of the current 
speech sample. 

[0003] One of the problems with this LP analysis is that it performs the analysis of the speech within each 
frame in isolation from the speech within other frames. It also assumes that the same number of weightings or 
coefficients will represent the speech within each time frame. As a result, errors can be introduced making 
subsequent recognition processing or the like more prone to error. 

[0004] An aim of the present invention is to provide an alternative technique for pre-possessing speech prior 
to use in a speech recognition system, a speech encoding system, a speaker verification system or the like. 
[0005] Exemplary embodiments of the present invention will now be described with reference to the accompanying 
drawings in which: 

Figure 1 is a schematic view of a computer which may be programmed to operate in accordance with an 
embodiment of the present invention; 

Figure 2 is a block diagram illustrating the principal components of a speech recognition system; 

Figure 3 is a block diagram representing a model employed by a statistical analysis unit which forms part of the 
speech recognition system shown in Figure 2; 

Figure 4 is a flow chart illustrating the processing steps performed by a model order selection unit forming 
part of the statistical analysis unit shown in Figure 2; 

Figure 5 is a flow chart illustrating the main processing steps employed by a Simulation Smoother which forms 
part of the statistical analysis unit shown in Figure 2; 

Figure 6 is a block diagram illustrating the main processing components of the statistical analysis unit shown 
in Figure 2; 

Figure 7 is a memory map illustrating the data that is stored in a memory which forms part of the statistical 
analysis unit shown in Figure 2; 

Figure 8 is a flow chart illustrating the main processing steps performed by the statistical analysis unit shown 
in Figure 6; 

Figure 9a is a histogram for a model order of an auto regressive filter model which forms part of the model 
shown in Figure 3; 

Figure 9b is a histogram for the variance of process noise modelled by the model shown in Figure 3; 
Figure 9c is a histogram for a third coefficient of the AR filter model; 

Figure 10 is a block diagram illustrating the main components of an alternative speech recognition system in 
which data output by the statistical analysis unit is used to detect the beginning and end of speech within the 
input signal; 

Figure 11 is a schematic block diagram illustrating the principal components of a speaker verification system; 

Figure 12 is a schematic block diagram illustrating the principal components of an acoustic classification system: 

Figure 13 is a schematic block diagram illustrating the principal components of a speech encoding and 
transmission, and 



Figure 14 is a block diagram illustrating the principal components of a data file annotation system which uses 
the statistical analysis unit shown in Figure 6 to provide quality of speech data for an associated annotation. 



15 



[0006] Embodiments of the present invention can be implemented on computer hardware, but the embodiment to 
be described is implemented in software which is run in conjunction with processing hardware such as a personal 
computer, workstation, photocopier, facsimile machine or the like. 

[0007] Figure 1 shows a personal computer (PC) 1 which may be programmed to operate an embodiment of the 
present invention. A keyboard 3 t a pointing device 5, a microphone 7 and a telephone line 9 are connected to the PC 
1 via an interface 11. The keyboard 3 and pointing device 5 allow the system to be controlled by a user. The 
microphone 7 converts the acoustic speech signal of the user into an equivalent electrical signal and supplies this 
) 10 to the PC 1 for processing. An internal modem and speech receiving circuit (not shown) may be connected to the 
telephone line 9 so that the PC 1 can communicate with, for example, a remote computer or with a remote user. 
[0008] The program instructions which make the PC 1 operate in accordance with the present invention may be 
supplied for use with an existing PC 1 on, for example, a storage device such as a magnetic disc 13, or by 
downloading the software from the Internet (not shown) via the internal modem and telephone line 9. 
[0009] The operation of a speech recognition system embodying the present invention will now be described with 
reference to Figure 2. Electrical signals representative of the input speech from the microphone 7 are input to a 
filter 15 which removes unwanted frequencies (in this embodiment frequencies above 8 kHz) within the input signal. 
The filtered signal is then sampled (at a rate of 16 kHz) and digitised by the analogue to digital converter 17 and 
the digitised speech samples are then stored in a buffer 19. Sequential blocks (or frames) of speech samples are 
then passed from the buffer 19 to a statistical analysis unit 21 which performs a statistical analysis of each frame 
20 of speech samples in sequence to determine, amongst other things, a set of auto regressive (AR) coefficients 
representative of the speech within the frame. In this embodiment, the AR coefficients output by the statistical 
analysis unit 21 are then input, via a coefficient converter 23 to a cepstral based speech recognition unit 25. In 
this embodiment, therefore, the coefficient converter 23 converts the AR coefficients output by the analysis unit 21 
into cepstral coefficients. This can be achieved using the conversion technique described in, for example, 
"Fundamentals of Speech Recognition" by Rabiner and Juang at pages 115 and 116. The speech recognition unit 25 
25 then compares the cepstral coefficients for successive frames of speech with a set of stored speech models 27, which 
may be template based or Hidden Markov Model based, to generate a recognition result. 

Statistical Analysis Unit - Theory and Overview 

3Q [0010] As mentioned above, the statistical analysis unit 21 analyses the speech within successive frames of the 
input speech signal. In most speech processing systems, the frames are overlapping. However, in this embodiment, the 
frames of speech are non-overlapping and have a duration of 20ms which, with the 16kHz sampling rate of the 
analogue to digital converter 1 7, results in a frame size of 320 samples. 

[0011] In order to perform the statistical analysis on each of the frames, the analysis unit 21 assumes that 
there is an underlying process which generated each sample within the frame. The model of this process used in this 

35 embodiment is shown in Figure 3. As shown, the process is modelled by a speech source 31 which generates, at time t 
= n, a raw speech sample s(n). Since there are physical constraints on the movement of the speech articulators, 
there is some correlation between neighbouring speech samples. Therefore, in this embodiment, the speech source 31 
is modelled by an auto regressive (AR) process. In other words, the statistical analysis unit 21 assumes that a 
current raw speech sample (s(n)) can be determined from a linear weighted combination of the most recent previous 

^ raw speech samples, i.e.; 

s[n) - a^s(n-1 ) + a 2 s(n-2) + + a k s(n-k) + e(n) (1 ) 

where a v a 2 a k are the AR filter coefficients representing the amount of correlation between the speech samples; 

k is the AR filter model order; and e(n) represents random process noise which is involved in the generation of the 
raw speech samples. As those skilled in the art of speech processing will appreciate, these AR filter coefficients 

45 are the same coefficients that the linear prediction (LP) analysis estimates albeit using a different processing technique. 
[0012] As shown in Figure 3, the raw speech samples s(n) generated by the speech source are input to a channel 
33 which models the acoustic environment between the speech source 31 and the output of the analogue to digital 
converter 17. Ideally, the channel 33 should simply attenuate the speech as it travels from the source 31 to the 
microphone 7. However, due to reverberation and other distortive effects, the signal (y(n)) output by the analogue 
to digital converter 17 will depend not only on the current raw speech sample *(s(n)) but it will also depend upon 

50 previous raw speech samples. Therefore, in this embodiment, the statistical analysis unit 21 models. the channel 33 
by a moving average (MA) filter, i.e.: 

y(n) = fy) s ( n ) + >>iS(r>-1 ) + h 2 s(n-2) + + h r s(n-r) + e(n) (2) 

where y(n) represents the signal sample output by the analogue to digital converter 17 at time t = n; ho, h 1t h 2 ....h r are 
55 the channel filter coefficients representing the amount of distortion within the channel 33; r is the channel filter model 
order; and e (n) represents a random additive measurement noise component. 



th?!* . F ° r thS ° Urr 5 n . t f !L ame ° f Spe8Ch being P rocessed - 'he filter coefficients for both the speech source and 

but unknown - Therefore - considering a " N samp,es < whe - N - 320 " s 

= a^n-l) + a 2 j(«-2) + + a k s{n-k) + e( w ) 

= 0^(11-2) + a 2 s(n-3) + + a t s(n-k-\) + e(«-l) 



(3) 



s(n-N+l) = + a 2 sfyt-N-l) + + ^ (w-jfc-JV+1) + 

which can be written in vector form as: 

s(n) = S.a + e(n) 



where 



and 



(4) 



S = 



s(n-l) s(n-2) s(n-3) 
s(n-2) s(n-3) s (n-4) 
s(n-3) s(n-4) s(n-5) 



s(n-N) s(n-N-l) s(n-N-2) 



s(n-k) 
s(n-k-\) 
s{n-k-2) 



s{n-k-N+\) 



Nxk 



£(71) = 



kxl 



s{n-2) 



Nxl 



e.(n) = 



e(n) 
e(n-\) 
e(n-2) 



e(n-N+\) 



Niet 



f™^^™" be aPParent f w m « the l° IIOWing discussion - il is also convenient to rewrite equation (3) 
terms of the random error component (often referred to as the residual) e(n). This gives: 

e(n) = s(n) - a,j(n-l) - a 2 s(n-2) - - a t s(n-k) 

e(w-l) = s(n-l) - a,j(«-2) - a 2 s(n-3) - - a k s(n-k-\) 

(5) 



in 



e(w-tf+l) = - ^(w-TV) - a 2 *(«-AM) - - a k s{n-k-N+\) 

which can be written in vector notation as: 

where (6) 
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0 1 -a } -a 2 
0 0 1 -a, 



-*k-\ 



0 



0 0 . 
0 0 . 
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[0015] Similarly, considering the channel model defined by equation (2), with h 0 = 1 (since this provides a more 
stable solution), gives: 

q(n) =h x s(n-l) +h 2 s(n-2) + .. +h r s(n-r) +e(«) 
q(n-l) = h x s(n-2) +h 2 s(n-3) + +/* r s(w-r-l) +e(n-l) 



(7) 



q(n-N+l) =h x s(n-N) +h 2 s(n-N-l) + .. +h r s(n-r-N+l) + e(n-iV+l) 

(8) 



(where q(n) = y(n) - s(n)) which can be written in vector form as: 

q(n) = V.h + £ (n) 
where 



*(»-!) 
s(n-2) 
jOi-3) 



*(«-2) 
j(«-3) 

j(»-4) 



j(»-3) 
s(«-4) 
*(/i-5) 



s(n-r) 
s(n-r-l) 
s(n-r-2) 



s(n-N) s(n-N-\) s{n-N-2) 



s(n-r-N+l) \ Nxr 



and 



k = 



A, 



<7(«) 
<7(/r-l) 

9(/«-2) 



5("-AM)J, vw 



e(n-l) 
e(/i-2) 



[0016] In this embodiment, the analysis unit 21 aims to determine, amongst other things, values for the AR 
filter coefficients (a) which best represent the observed signal samples (y(n)) in the current frame. It does this by 
determining the AR filter coefficients (a) that maximise the joint probability density function of the speech model, 
channel model, raw speech samples and the noise statistics given the observed signal samples output from the 
analogue to digital converter 17, i.e. by determining: 



max 

a 



(9) 



where a J and « * represent the process and measurement noise statistics respectively. As those skilled in the art 
will appreciate, this function defines the probability that a nartirniar c™^h u 

samples and noise statistics generated ^observed Trame oi speech Tamoles S Smlt^fo' ^ 
converter. To do this, the statistical analysis unit 21 must determine whTThii w£n , ,f *E ^ '° d ' 9ltal 
can be simplffled by rearranging this probably density fa^?£?^i£; h J nC,,on '°° kS Th,S problem 



p(y(n)|s(n),h/,a 2 Jp(s(n)|a,k, CT 2 e )p(a|/()p(h|f)p(cT2Jp( CT 2 e )p (/ ( )p( f ) 

P(y(n)) 



(10) 



^rn' ( '! e o r ,. c<,e " en,s ,hat ,un * n **-Tis?S5 i.'t^risrs 

[001 8] Each of the terms on the numerator of equation (1 0) will now be considered in turn 
P(s(n)\a, k, CT e z ) 

). From equation (6) above, this joint probability density function for the raw speech samples can be determined 
from the jo.nt probability density function for the process noise. In particular p(s(n)|a, k, CTe 2 ) is given by: 



p{s.(ri)\a,k,° e ) = />(*(«)) 



5i(») 



£-(ri) = £ ( n ) - Sa 



(11) 



where p(e(n)) is the joint probability density function for the process noi«!f» dnrinn fr, m „ »h • 

and the second term on the right-hand side is known asLSennftLi the input speech 

Jacobean is unity because of the triangular form of the ^ ln ,hls case - the 

~* ' n ^ en L b0diment ' the statistical analvsis unit 21 assumes that the process noise associated with the 
speech source 31 is Gaussian having zero mean and some unknown variance ^. The statistical analysis unit 21 

also assumes that the process noise at one time Doint is inriorvanHont ^ ^ „ m 4 iL 

Therefore, the joint probability density function for °he proc2 not£ during ? «f°m * t,me , P ? int - 

defines the probabilrtyof any gK/en vector of process notaS^^JX. ^ " ^ ^ 



= (2nct) 2 exp 



2of 



(12) 



[0021] Therefore, the joint probability density function for a vector of raw speech samples qrven the AR filter 
coefficents (a), the AR filter model order (k) and the process noise variance (a e 2 ) is gK/en by 



pU(ri)\a,k,ct) = (2«<) 2 exp 



— \ (i(n) T s.(n) - 2a T Si(n) + a T S r Sa) 
2o. ' 



(13) 



PMn)\s(n),h,r,o e 2 ) 



5 £ (/i) 



(14) 
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where p(e(n)) is the joint probability density function for the measurement noise during a frame of the input 
speech and the second term on the right hand side is the Jacobean of the transformation which again has a value 
of one. 

[0023] In this embodiment, the statistical analysis unit 21 assumes that the measurement noise is Gaussian 
having zero mean and some unknown variance CTe 2 It also assumes that the measurement noise at one time point is 
independent of the measurement noise at another time point. Therefore, the joint probability density function for 
the measurement noise in a frame of the input speech will have the same form as the process noise defined in 
equation (12). Therefore, the joint probability density function for a vector of speech samples (y(n)) output from the 
analogue to digital converter 17, given the channel filter coefficients (h), the channel filter model order (r), the 
measurement noise statistics ( CTe 2 ) and the raw speech samples (s(n)) will have the following form: 



15 



P<jdLn)\s{n),h,r t o B ) = (2 tut,) 2 exp 



^ [z(n) T 2{n) - ItSY^n) + k T Y T Y k) 



2a 



(15) 



20 



25 



[0024] As those skilled in the art will appreciate, although this joint probability density function for the 
vector of speech samples (y(n)) is in terms of the variable a(n), this does not matter since g(n) is a function of y(n) 
and s(n), and s(n) is a given variable (ie known) for this probability density function. 
Pfa|Acj 

[0025] This term defines the prior probability density function for the AR filter coefficients (a) and it allows 
the statistical analysis unit 21 to introduce knowledge about what values it expects these coefficients will take. 
In this embodiment, the statistical analysis unit 21 models this prior probability density function by a Gaussian 
having an unknown variance (cr a 2 ) and mean vector (14), Le.: 



30 



J p(a|*.<J«.jO 



(2no 2 a ) 



N 
2 



exp 



2at 



(16) 



35 



40 



[0026] By introducing the new variables CTa 2 and the prior density functions (p(cr a 2 ) and pftjj) for these 
variables must be added to the numerator of equation (10) above. Initially, for the first frame of speech being 
processed the mean vector (yj can be set to zero and for the second and subsequent frames of speech being 
processed, it can be set to the mean vector obtained during the processing of the previous frame. In this case, pfuj is 
just a Dirac'delta function located at the current value of u^ and can therefore be ignored. 

[0027] With regard to the prior probability density function for the variance of the AR filter coefficients, the 
statistical analysis unit 21 could set this equal to some constant to imply that all variances are equally probable. 
However, this term can be used to introduce knowledge about what the variance of the AR filter coefficients is 
expected to be. In this embodiment, since variances are always positive, the statistical analysis unit 21 models 
this variance prior probability density function by an Inverse Gamma function having parameters otg and p a , i.e.: 



45 



P a r(a) 



exp 



(17) 



[0028] At the beginning of the speech being processed, the statistical analysis unit 21 will not have much 
knowledge about the variance of the AR filter coefficients. Therefore, initially, the statistical analysis unit 21 
sets the variance a a 2 and the a and p parameters of the Inverse Gamma function to ensure that this probability 
density function is fairly flat and therefore non-informative. However, after the first frame of speech has been 
processed, these parameters can be set more accurately during the processing of the next frame of speech by using 
the parameter values calculated during the processing of the previous frame of speech. 



P(hW 

Ko 1 , h 7 r iS ,- ,er , m re P resents the P"'°' probability density function for the channel model coefficients (M and it 
allows the s atis teal analysis unit 21 to introduce knowledge about what values it expSTh«S^SffcteS?to 
£5L« h \ P t rK,r .P robabilit y dens «y fencflon for the AR filter coefficients, 'T^S^SSSTThS 
probability densrty function b modelled by a Gaussian having an unknown variance („„*) and mean vector (£) fe 



N 



p(h\r,<j h ,u) = (2koI) 2 exp 



2o£ 



(18) 



[0030] Aga.n, by introducing these new variables, the prior density functions (p( CTh ) and p( Uh) ) must be added to 

— n h m h era L 0r ° f eqUat,0ri L (10) - Again ' the mean vector can ini,ial| y be set to zero and after the first frame of 
speech has been processed and for all subsequent frames of speech being processed the mean vector can teLrf tJ 
equal the mean vector obtained during the processing of the previous frame. Therefore p( Uh ) ?£> *i a Dirac 
delta function located at the current value of y h and can be ignored. 

Ln° a i 1] i„ Wi,h K r !? ard , to . '. he . P"' or Probability density function for the variance of the channel filter coefficients 
agam, ,n this embodiment, this ,s modelled by an Inverse Gamma function having parameters ^and p h Again Te 
variance (a h ) and the a and p parameters of the Inverse Gamma function can be chosen initially so that these 
densit.es are non-informative so that they will have little effect on the subsequent processing of the initial frame 
P(cr e ; ana p(a e ) 

Eh 3 =Lo I heSe { T mS ^ e ^ e .P n ' or Probability density functions for the process and measurement noise variances 
nnL f * 56 fT, ' the A statls,ical analysis unit 21 to introduce knowledge about what val^s it ejects thesl 
no.se variances will take. As with the other variances, in this embodiment the statistical aSteunT?1 
these by an Inverse Gamma function having parameters cc e . Pe and ^^X^Xse^ncT^ 

Sth G e^ 50 ™ ^ - non-informat,e and wil, not a PP reciab,y 

p(k) andp(r) 

ISSSL,* T A 6Se t6rmS f 6 , the Pri0 ' P robab ility density functions for the AR filter model order (k) and the channel 
Z J TZSlT P ?? WeW - 10 tNS embodiment - ,hese are modelled by a uniform distribution up to some ^ maximum 
order. In this way, there is no prior bias on the number of coefficients in the models exceot that ran 
exceed these predefined maximums. In this embodiment, the maximum AR filter ™del 0 S k s thK and the 
maximum channel model order (r) is one hundred and fifty. ( ; y and the 

• I00 f 4] u i _. i . Therefore - inserting the relevant equations into the numerator of equation (10) qives the follow™ 
joint probability density function which is proportional to PteXhs.* ^a^M^tim 
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15 



20 



(27io c ) 2 exp 



2o; 



\ («(«) r a(«) - ItfY^ri) * h T Y T Yh) 



N 

V 2 , 



x (27to e ) 2 exp 



— l - (i(«) r i(w) - 2a r Si(r,) + a T S r S a) 



N 



x (2no 0 ) 2 exp 



2oL 

-(fl-u/Ca-iO 



2o' 



x (2jco^) 2 exp 



-(&-ii/0i-u A ) 



(a 2 )- ( °- M) 

x exp 

P^OO 


-1 


x exp 

P*n°*> 


-1 

. 0 *p* 


(a 2 )- ( °' M) 
x exp 

P e r(a e ) 


-l 


(a 2 )^ +,) 

x exp 

P E r(« c ) 


.^pj 



2o u 



(19) 
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Gibbs Sampler 

[0035] In order to determine the form of this joint probability density function, the statistical analysis unit 
21 "draws samples" from it. In this embodiment, since the joint probability density function to be sampled is a 
complex multivariate function, a Gibbs sampler is used which breaks down the problem into one of drawing samples 
from probability density functions of smaller dimensionality. In particular, the Gibbs sampler proceeds by drawing 
random variates from conditional densities as follows: 



first iteration 



P( a ,A|/7° AV 2 °e. ° 2 °*' ° *' ~+- U ^ 

P(h.'|a,,o a 2° e , CT 2° e , a* 0 .. * 2 \> s{nf, y(n)) -►hi. A 1 



40 



45 



p(cr 2l Jai,A 1 ,i2 ir i tCT2 i E , CT 2 1 a ,cT2 1 ^s(n) 0 ,y (n)) _> a i\ 



second iteration 



50 



55 



P(a,/<|h l!/ .1 iCT 2 1 9 , ( T 2l E .CT 2, /,.S(/?)',i/(A7)) -> 32,/C 2 

P(h^|a 2A2>CT2 i e , a 2i E , CT 2i a ,a2\.s(n)i,y( n )) -» 



etc. 

f ,h Wh r? /""I K2)0, ^ ^ (tTh2) °' §(n)0) are initial va,ues which may be obtained from the 

23^^^^^ - — ^ Z'Z 



« exp 



which can be simplified to give: 



-1 



2d! 



(i(») r i(») - 2a 7 Ss(«) + a T S T S a) 



exp 



2oj 



(20) 



p(a,k\...) « exp 



-2a 3 



+ a J 



+ — - 



2 2 



S 7 ^ / 



2 2 



a 



which is in the form of a standard Gaussian distribution having the following covariance matrix: 



+ 

2 2 



(22) 



(21) 





-1 




c a 




2 2 

6 °». 



(23) 



[0039] 



A sample can then be drawn from this standard Gaussian distribution to give a" (where g is the 



10 



g lh iteration of the Gibbs sampler) with the model order (k 9 ) being determined by a model order selection routine 
which will be described later. The drawing of a sample from this Gaussian distribution may be done by using a random 
number generator which generates a vector of random values which are uniformly distributed and then using a 
transformation of random variables using the covariance matrix and the mean value given in equatbns (22) and (23) 
to generate the sample. In this embodiment, however, a random number generator is used which generates random 
numbers from a Gaussian distribution having zero mean and a variance of one. This simplifies the transformation 
process to one of a simple scaling using the covariance matrix given in equation (22) and shifting using the mean 
value given in equation (23). Since the techniques for drawing samples from Gaussian distributions are well known in 
the art of statistical analysis, a further description of them will not be given here. A more detailed description 
and explanation can be found in the book entitled "Numerical Recipes in C", by W. Press et al, Cambridge University 
Press, 1 992 and in particular at chapter 7. 

[0040] As those skilled in the art will appreciate, however, before a sample can be drawn from this Gaussian 
distribution, estimates of the raw speech samples must be available so that the matrix S and the vector s(n) are known. 
The way in which these estimates of the raw speech samples are obtained in this embodiment will be described later. 
[0041] A similar analysis for the conditional density p(h,r|...) reveals that it also is a standard Gaussian 
distribution but having a covariance matrix and mean value given by: 
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20 from which a sample for h 9 can be drawn in the manner described above, with the channel model order (r 9 ) being 
determined using the model order selectbn routine which will be described later. 
[0042] A similar analysis for the conditional density p(<7 e 2 |.-) shows that: 
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where: 

which can be simplified to give: 
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which is also an Inverse Gamma distribution having the following parameters: 

N '- 2"p e 
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(27) 



[0043] A sample is then drawn from this Inverse Gamma distribution by firstly generating a random number from a 
uniform distribution and then performing a transformation of random variables using the alpha and beta parameters 
given in equation (27), to give (a e 2 ) 9 - 
45 [0044] A similar analysis for the conditional density p(a e 2 |-..) reveals that it also is an Inverse Gamma 
distribution having the following parameters: 

- N - 2p e 

a s = y + a £ end p = c ^ + ^ ^ (28) 

50 where: 

E* = q(n) T q(n) - 2hrYg(n) + hrY 7 Vh 
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[0045] A sample is then drawn from this Inverse Gamma distribution in the manner described above to give (<r e 2 ) 9 - 
[0046] A similar analysis for conditional density p(cr a 2 |...) reveals that it too is an Inverse Gamma distribution 
having the following parameters: 
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[0047] A sample is then drawn from this Inverse Gamma distribution in the manner described above to dive (* 2 Y> 

[0048] Similarly -■ ...... ^ > ■ 

following parameters: 



[0048] Similarly, the conditional density p^)...) is also an Inverse Gamma distribution but having the 
ameters: 
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10 [0049] A sample is then drawn from this Inverse Gamma distribution in the manner described above to give („ 2 V> 

conveL t th0SS ■?? d in Wi " aPPreCiate> the Gibbs Sam P ,er re " uires ■« initial transient period to 

converge to equJfcnum (known as burn-in). Eventually, after L iterations the 

T^L ( - ; \?; ; ^ } ■ (<Te >S ^ ^ S(n)L) iS C ° nsidered 10 be a «"•»*» from »» joint probability 

20 values for the G.bbs sampler when it processes the next frame of speech. n,t,al 
Model Order Selection 

I0 !? 511 / x «^ mentioned above, during the Gibbs iterations, the model order (k) of the AR filter and tho mnri^i 
order (r) of the channel filter are updated using a model order selection routine I lhT eSEodEJS th£ t 
ESS? i U Th 9 3 teChn, ' q ^ PP" from "^ersible jump Markov chain S^(li^oS^^v^ I 
S^Sl. '"J^Pfer entitled "Reversible jump Markov chain Monte Carlo Computation and San model 
determination by Peter Green, Biometrika, vol 82, pp 71 1 to 732 1995 H tsayesian model 

E25L . Fi9U f re ,t iS Ao /l° W ° hart WhiCh illustrates the Processing steps performed during this model order 
selector, routine for the AR filter model order (k). As shown, in step s1, a new model order (k 2 ) is proposed In i t* 

30 e ?p°l!nH e ?' ^ ° rd t r Wi " n0rma " y be Pr ° P0Sed 33 k * = k ' * 1 - but occasionally it wiHbe p'opose^ as k 2 = k 

d^ T T ° CCaS T l,y " k 2 = k i ± 3 etc. To achieve this, a sample b drawn from a diseased Laplacian 
densrty function centred on the current model order (k,) and with the variance of this Laplacian density function 

?005 9 31 Th^r ' n aCC ^ ance with J he de S ree of -mpling «* *» model order space that is required * 
[0053] The processing then proceeds to step s3 where a model order variable (MO) is set equal to: 



MO = max h 



(31) 



ffli™ffi^ni°^ rm iS th !f the conditional Probability given in equation (21) evaluated for the current AR 

Tnf f rk thl^ 

S r » J 2 > u k '\ then ,he matnx s must first be resized and then a new sample must be drawn from the Gaussian 
d^nbuton having the mean vector and covariance matrix defined by equations (22) and S ^determined Z7Z 
rested matr* S). to provide the AR filter coefficients (a.^) for the n'ew'model oSe! (5 ?g fk E all °h a !t 
required .s to delete the last, (k, - k 2 ) samples from the fl vector. If the ratio in equatbn (31) is greater than one 

"T,""" «" d a »» »» K 2 £ incrementeS TcT»2 the? to? SS 

model order unable (MO) is smaler than the random number, then Ihe processing proceeds lo st.o ss h! 

incremented. The processing then ends. v 1; 
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[0054] This model order selection routine is carried out for both the model order of the AR filter model and 
for the model order of the channel filter model. This routine may be carried out at each Gibbs iteration. However, this 
is not essential. Therefore, in this embodiment, this model order updating routine is only carried out every third 
Gibbs iteration. 

Simulation Smoother 

[0055] As mentioned above, in order to be able to draw samples using the Gibbs sampler, estimates of the raw 
speech samples are required to generate s(n), S and Y which are used in the Gibbs calculations. These could be 
obtained from the conditional probability density function p(s(n)|...). However, this is not done in this embodiment 
because of the high dimensionality of S(n). Therefore, in this embodiment, a different technique is used to provide 
the necessary estimates of the raw speech samples. In particular, in this embodiment, a "Simulation Smoother" is 
used to provide these estimates. This Simulation Smoother was proposed by Piet de Jong in the paper entitled The 
Simulation Smoother for Time Series Models", Biometrika (1995), vol 82,2, pages 339 to 350. As those skilled in the 
art will appreciate, the Simulation Smoother is run before the Gibbs Sampler. It is also run again during the Gibbs 
iterations in order to update the estimates of the raw speech samples. In this embodiment, the Simulation Smoother 
is run every fourth Gibbs iteration. 

[0056] In order to run the Simulation Smoother, the model equations defined above in equations (4) and (6) must 
be written in "state space" format as follows: 
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£(n) = A.§{n-\) + £(rt) 
y(n) = & r .£(7i-l) + e(«) 



(32) 



where 
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[0057] With this state space representation, the dimensionality of the raw speech vectors (s-(n)) and the process 
noise vectors (e(n)) do not need to be Nx1 but only have to be as large as the greater of the model orders - k and 
r. Typically, the channel model order (r) will be larger than the AR filter model order (k). Hence, the vector of raw speech 
samples (§:(n)) and the vector of process noise (e(n)) only need to be rx1 and hence the dimensionality of the matrix 
only needs to be rxr. 

[0058] The Simulation Smoother involves two stages - a first stage in which a Kalman filter is run on the 
speech samples in the current frame and then a second stage in which a "smoothing" filter is run on the speech 
samples in the current frame using data obtained from the Kalman filter stage. Figure 5 is a flow chart illustrating 
the processing steps performed by the Simulation Smoother. As shown, in step s21, the system initialises a time 
variable t to equal one. During the Kalman filter stage, this time variable is run from t = 1 to N in order to 



or^ff th6 ,K N SPeeCh !f m P leS in the CUrrent frame bein 9 Processed in time sequential order. After step s21 the 

.n^TJ 5 ft ^K 6edS l ° StSP f 23 ' WhSre the fo " OWin 9 Kalman filter equations are computed for the current 
speech sample (y(t)) being processed: 
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where the initial vector of raw speech samples )) includes raw speech samples obtained from the processing of the 
previous frame (or if there are no previous frames then s(i) is set equal to zero for i < 1); P(1) is the variance of 
(which can be obtained from the previous frame or initially can be set to CTe 2 ); h is the current set of channel model 
coefficients which can be obtained from the processing of the previous frame (or if there are no previous frames 

KL ^In 6 a Ca ?, be . S u et ■!? their 6XpeCted values " zero > ; is tne current s P e ^h sample of the current 
5 e ± P messed and I is the identity matrix. The processing then proceeds to step s25 where the scalar values 
w(t) and d(t) are stored together with the rxr matrix L(t) (or alternatively the Kalman filter gain vector Ml) could be 
ShiT Wh ,' Ch l ,S ( K ) ° an be 9 enerated )-. The Processing then proceeds to step s27 where the system determines 
whether or not all the speech samples in the current frame have been processed. If they have not then the 
^^JT^ t0 ste Pf 9 " here the «™ variaWe t is incremented by one so that the next samp e in he 
current frame will be processed in the same way. Once all N samples in the current frame have been processed in this 
way and the corresponding values stored, the first stage of the Simulation Smoother is complete 

k 5 ?^ ThS ^ oce ^ then Proceeds to step s3 1 where the second stage of the Simulation Smoother is started in 
which the smoothing filter processes the speech samples in the current frame in reverse sequential order As shown 
in step s3 the system runs the following set of smoothing filter equations on the current speech sample beina 
processed together with the stored Kalman filter variables computed for the current speech sample being processed* 

C(t) = o\U{t)) 
HG) ~N{Q,C{f)) 
V{t) = a 2 e U(t)L(t) 
L(t-l) = hd(t)- l w(t) + L{t) T c{t) - VitfCity^it) 

(34) 

U(t-i) = hd(ty l h T + L(t) T u(t)L(t) + v(t) T c(ry l v(t) 

e(0 = o 2 e r(0 + n(0 where £(/) = [e(f) e(/-l) e(t-2) ... e(r-r+l)] r 
K0 = A£(t-l) + £(r) where i(t) = [f(f) £(t-l) f(f-2) ... s{t-r+l)] T 

and £(t) = [e(t) 0 0 ... 0 ] r 

v^Z r/»-m Tk^ ^T" f ?- m ,1?%?**™ distribution havin 9 zero mean and covariance matrix C(t); the initial 

oSL?fr^L?nr ^hI? ^ U(t=N) f' 6 b ° th 361 t0 Zer ° ; and S(0 > is ob,ained from the Processing of the 
previous frame (or <f here are no previous frames can be set equal to zero). The processing then proceeds to step 
s33 where the est.mate of the process noise ( g (t)) for the current speech sample being processed and the estimate 
of the raw speech sample (s-(t)) for the current speech sample being processed are stored. The processing then 
proceeds to step s35 where the system determines whether or not all the speech samples in the current frame have 



been processed. If they have not, then the processing proceeds to step s37 where the time variable t is decremented 
by one so that the previous sample in the current frame will be processed in the same way. Once all N samples in the 
current frame have been processed in this way and the corresponding process noise and raw speech samples have 
been stored, the second stage of the Simulation Smoother is complete and an estimate ofs(n) will have been 
generated. 

[0060] As shown in equations (4) and (8), the matrix S and the matrix Y require raw speech samples s(n-N-1) to 
s(n-N-k+1 ) and s(n-N-1 ) to s(n-N-r+1 ) respectively in addition to those in s(n). These additional raw speech samples can 
be obtained either from the processing of the previous frame of speech or if there are no previous frames, they can 
be set to zero. With these estimates of raw speech samples, the Gibbs sampler can be run to draw samples from the 
above described probability density functions. 

Statistical Analysis Unit - Operation 

[0061] A description has been given above of the theory underlying the statistical analysis unit 21. A 
description will now be given with reference to Figures 6 to 8 of the operation of the statistical analysis unit 21. 
[0062] Figure 6 is a block diagram illustrating the principal components of the statistical analysis unit 21 of 
this embodiment. As shown, it comprises the above described Gibbs sampler 41, Simulation Smoother 43 (including the 
Kalman filter 43-1 and smoothing filter 43-2) and model order selector 45. It also comprises a memory 47 which 
receives the speech samples of the current frame to be processed, a data analysis unit 49 which processes the data 
generated by the Gibbs sampler 41 and the model order selector 45 and a controller 50 which controls the operation 
of the statistical analysis unit 21 . 

[0063] As shown in Figure 6, the memory 47 includes a non volatile memory area 47-1 and a working memory area 
47-2. The non volatile memory 47-1 is used to store the joint probability density function given in equation (19) 
above and the equations for the variances and mean values and the equations for the Inverse Gamma parameters 
given above in equations (22) to (24) and (27) to (30) for the above mentioned conditional probability density 
functions for use by the Gibbs sampler 41. The non volatile memory 47-1 also stores the Kalman filter equations 
given above in equation (33) and the smoothing filter equations given above in equation 34 for use by the Simulation 
Smoother 43. 

[0064] Figure 7 is a schematic diagram illustrating the parameter values that are stored in the working memory 
area (RAM) 47-2. As shown, the RAM includes a store 51 for storing the speech samples y f (1 ) to y f (N) output by the 
analogue to digital converter 17 for the current frame (f) being processed. As mentioned above, these speech samples 
are used in both the Gibbs sampler 41 and the Simulation Smoother 43. The RAM 47-2 also includes a store 53 for 
storing the initial estimates of the model parameters (g=0) and the M samples (g = 1 to M) of each parameter drawn 
from the above described conditional probability density functions by the Gibbs sampler 41 for the current frame 
being processed. As mentioned above, in this embodiment, M is 100 since the Gibbs sampler 41 performs 150 
iterations on each frame of input speech with the first fifty samples being discarded. The RAM 47-2 also includes a 
store 55 for storing W(t), d(t) and L(t) for t = 1 to N which are calculated during the processing of the speech samples in 
the current frame of speech by the above described Kalman filter 43-1 . The RAM 47-2 also includes a store 57 for 
storing the estimates of the raw speech samples (s- f (t)) and the estimates of the process noise (e f >(t)) generated by 

the smoothing filter 43-2, as discussed above. The RAM 47-2 also includes a store 59 for storing the model order 
counts which are generated by the model order selector 45 when the model orders for the AR filter model and the 
channel model are updated. 

[0065] Figure 8 is a flow diagram illustrating the control program used by the controller 50, in this 

embodiment, to control the processing operations of the statistical analysis unit 21. As shown, in step s41, the 
controller 50 retrieves the next frame of speech samples to be processed from the buffer 19 and stores them in the 
memory store 51 . The processing then proceeds to step s43 where initial estimates for the channel model, raw speech 
samples and the process noise and measurement noise statistics are set and stored in the store 53. These initial 
estimates are either set to be the values obtained during the processing of the previous frame of speech or, where 
there are no previous frames of speech, are set to their expected values (which may be zero). The processing then 
proceeds to step s45 where the Simulation Smoother 43 is activated so as to provide an estimate of the raw speech 
samples in the manner described above. The processing then proceeds to step s47 where one iteration of the Gibbs 
sampler 41 is run in order to update the channel model, speech model and the process and measurement noise 
statistics using the raw speech samples obtained in step s45. These updated parameter values are then stored in the 
memory store 53. 

[0066] The processing then proceeds to step s49 where the controller 50 determines whether or not to update the 
model orders of the AR filter model and the channel model. As mentioned above, in this embodiment, these model 
orders are updated every third Gibbs iteration. If the model orders are to be updated, then the processing proceeds 
to step s51 where the model order selector 45 is used to update the model orders of the AR filter model and the 
channel model in the manner described above. If at step s49 the controller 50 determines that the model orders are 
not to be updated, then the processing skips step s51 and the processing proceeds to step s53. At step s53, the 
controller 50 determines whether or not to perform another Gibbs iteration. If another iteration is to be performed, then 
the processing proceeds to decision block s55 where the controller 50 decides whether or not to update the estimates 
of the raw speech samples (s(t)). If the raw speech samples are not to be updated, then the processing returns to 



step s47 where the next Gibbs iteration is run. 

[0067] As mentioned above, in this embodiment, the Simulation Smoother 43 is run every fourth Gibbs iteratbn 
b~n fn , °r^ at f th t e raw s P e ^ h , sam P' es - before, if the controller 50 determines, in step s55 that there has 
been four Gibbs rterations s.nce the last time the speech samples were updated, then the processing returns to steo 
s45 where the Simulation Smoother is run again to provide new estimates of the raw speech samX (Jn) Once he 
controller 50 has determined that the required 150 Gibbs iterations have been performed tZwlS^so causes 
the processing to proceed to step s57 where the data analysis unit 49 analyses the model order counts generatedbv 
Sn~° It »h 45 to determine 'he model orders for the AR filter model and the channel modefwh ch Tbest 

represents the .current frame of speech being processed. The processing then proceeds to step s59 where the data 

ARm^nJ^'ff t ^ mP ' e f 'T? from the COnditional densitie * b * the Gibbs sampler P 4Tto dete^rnine £ 
AR filter coefficients (a , the channel model coefficients (h), the variances of these coefficients and the process and 
measurement noise variances which best represent the current frame of speech being processed The proS? then 
proceeds to step s61 where the controller 50 determines whether or not there is an? furthlrTpeech tob procfsST 
f there is more speech to be processed, then processing returns to step S41 and the above process irre D eate?for 
the next frame of speech. Once all the speech has been processed in this way, the processing tnds P 

Data Analysis unit 

EfmlntinnoH T' 6 d ^ iled de ^ ri P tion ° f the data analysis unit 49 will now be given with reference to Figure 9 
As mentioned above the data analysis unit 49 initially determines, in step s57. the model orders for both the AR 
filter model and the channel model which best represents the current frame of speech being processed It doe! tf£ 
usmg the counts that have been generated by the model order selector 45 when it was run 7 S si? These °counte 
a n a .fi° red -?la e f°% 59 „° f the RAM 47 " 2 - ln this embodiment, in determining the best moSel orders The daS 

SSEE "?h h fTf eS 010(161 ° rder having the hi 9 hest count - Fi 9 ure 9a * an exemplary histogram wh£h 
Husfrates the d^tnbution of counts that is generated for the model order (k) of the AR filter model 9 Therefore 

Ln^fnTio ,h rf d3ta analy ^' S Unit 49 W ° Uld 861 the best order of tne AR filter rmdel^sfSe The date 

analysis unit 49 performs a s.milar analysis of the counts generated for the model order (r) of the channel model to 
determine the best model order for the channel model. K ' cnan nel model to 

[0069] Once _the data analysis unit 49 has determined the best model orders (k and r) it then analvses th P 
samples generated by the Gibbs sampler 41 which are stored in the store 53 of the RAM 47-2 in order S £n 
parameter values that are most representative of those samples. It does this by determining a hfetograrn .for eaS of 
the parameters from wh.ch rt determines the most representee parameter value. To generate the ^hisSTam the date 

dSTthi 11 "Jn det f ermines he m ™™ m and minimUm Sample value which was "rawn by the Gtobs samp^'and then 
K P arameter values ^tween this minimum and maximum value into a predetermined number of sub- 
^?Pnf h The daa analySIS unit 49 then assi 9 ns each of the sam Pte values into the appropriate bins ^nd 

^"t ?°l many ^P es are al,ocated t0 each bin- " then uses these counts to calculate a weighted average of Ihe 
samples (with the weighting used for each sample depending on the count for the corresponding bin) to determine hi 
most representative parameter value (known as the minimum mean square estimate (MMSE)). Figure 9b , SSfaS an 
example histogram which is generated for the variance ft,.*) of the process noise, from which the data analX uS 
49 determines that the variance representative of the sample is 0 3149 

[0070] In determining the AR filter coefficients (a, for i = i to k), the data analysis unit 49 determines and 
analvses a histogram of the samples for each coefficient independently. Figure 9c shows an exemolarv histogram 
obtained for the th,rd AR filter coefficient from which the data analysis 9 unit 49 deter^nesThT he coeS 
representative of the samples is -0.4977. 

K^ffinJ^ embodin :r { - the data analysis unit 49 only outputs the AR filter coefficients which are passed 

i^lS^TS^S^ n t , T e 2 - »I he remaining f ameter values determined by tne data S 

»hl ad ™ stored J n th f RAM 47 " 2 for use dur '"g the processing of the next frame of speech As mentioned above 
™n^h er coeff '2. ents ° ut P ut b y the statistical analysis unit 21 are input to the coefficient coSor S whfch 
converts these coefficients into cepstral coefficients which are then compared with stored speech models 27 bv the 
speech recognition unit 25 in order to generate a recognition result =>H«eon moaeis ^ / D y the 

SSZL i AS . S . ki " e u d read6r Wi " a PP reciate ' a s P eech Processing technique has been described above which uses 
SnS Th-?^ 3 techn,c ' ues to determine sets of AR filter coefficients representatK/e of an input speSh 
s.gnal The techrnque .s more robust and accurate than prior art techniques which employ maximum iteC 
est.mators to determine the AR filter coefficients. This is because the statistical anakL o eS frame uses 
™Xl?< ta ?^!*?J he P r ° c , essi »Z ° f ,he P rev ^* frame. In addition, with the aSJS perfo^ed above tt 
model order for the AR filter model is not assumed to be constant and can vary from frame to frame In this wav' he 
opt.mum number of AR filter coefficients can be used to represent the speech within each fram As a result the AR 
filter coefficients output by the statistical analysis unit 21 will more accurately repVS' the corrlsDond^ 

channel the AR filter coefficients that are determined will be more representative of the actual speech and will h* 
less hkey to mclude distortive effects of the channel. Further still, since variance , hfarSatiST? avaitebTe for 
each of the parameters, this provides an indication of the confidence of each of the parSSmltes ThS ?n 

^^^J^^^T 5 aPProaChe3 ' 33 — ~ ana^whe^^^ 



Alternative Embodiments 



[0073] In the above embodiment, the statistical analysis unit was used as a pre-processor for a speech 
recognition system in order to generate AR coefficients representative of the input speech. It also generated a 
number of other parameter values (such as the process noise variances and the channel model coefficients), but these 
were not output by the statistical analysis unit. As those skilled in the art will appreciate, the AR coefficients 
and some of the other parameters which are calculated by the statistical analysis unit can be used for other 
purposes. For example, Figure 10 illustrates a speech recognition system which is similar to the speech recognition 
system shown in Figure 2 except that there is no coefficient converter since the speech recognition unit 25 and 
speech models 27 are AR coefficient based. The speech recognition system shown in Figure 10 also has an additional 
speech detection unit 61 which receives the AR filter coefficients (a) together with the AR filter model order (k) 
generated by the statistical analysis unit 21 and which is operable to determine from them when speech is present 
within the signal received from the microphone 7. It can do this, since the AR filter model order and the AR filter 
coefficient values will be larger during speech than when there is no speech present. Therefore, by comparing the AR 
filter model order (k) and/or the AR filter coefficient values with appropriate threshold values, the speech 
detection unit 61 can determine whether or not speech is present within the input signal. When the speech detection 
unit 61 detects the presence of speech, it outputs an appropriate control signal to the speech recognition unit 25 
which causes it to start processing the AR coefficients it receives from the statistical analysis unit 21. Similarly, 
when the speech detection unit 61 detects the end of speech, it outputs an appropriate control signal to the speech 
recognition unit 25 which causes it to stop processing the AR coefficients it receives from the statistical analysis unit 21 . 
[0074] In the above embodiments, a speech recognition system was described having a particular speech pre- 
processing front end which performed a statistical analysis of the input speech. As the those skilled in the art 
will appreciate, this pre-processing can be used in speech processing systems other than speech recognition systems. 
For example, as shown in Figure 11, the statistical analysis unit 21 may form a front end to a speaker verification 
system 65. In this embodiment, the speaker verification system 65 compares the sequences of AR filter coefficients 
output by the statistical analysis unit 21 with pre-stored speaker models 67 to determine whether or not the 
received speech corresponds to a known user. 

[0075] Figure 12 illustrates another application for the statistical analysis unit 21. In particular, Figure 12 
shows an acoustic classification system. The statistical analysis unit 21 is used to generate the AR filter 
coefficients for an input audio signal (which may or may not be speech) in the manner described above. These 
coefficients are then passed to an acoustic classification system 66 which compares the AR coefficients from the 
statistical analysis unit with pre-stored acoustic models 68 to generate the classification result.. This 
classification system may be used, for example, to identify and categorise various input sounds, for example, 
percussion sounds, woodwind sounds, brass sounds as well as speech. 

[0076] Figure 13 illustrates another application for the statistical analysis unit 21. In particular, Figure 13 
shows a speech encoding and transmission system. The statistical analysis unit 21 is used to generate the AR filter 
coefficients in the manner described above, which are then passed to a channel encoder which encodes the sequences 
of AR filter coefficients so that they are in a more suitable form for transmission through a communications 
channel. The encoded AR filter coefficients are then passed to a transmitter 73 where the encoded data is used to 
modulate a carrier signal which is then transmitted to a remote receiver 75. The receiver 75 demodulates the 
received signal to recover the encoded data which is then decoded by a decoder 76. The sequences of AR filter 
coefficients output by the decoder are then either passed to a speech recognition unit 77 which compares the 
sequences of AR filter coefficients with stored reference models (not shown) to generate a recognition result or to 
a speech synthesis unit 79 which re-generates the speech and outputs it via a loudspeaker 81. As shown, prior to 
application to the speech synthesis unit 79, the sequences of AR filter coefficients may also pass through an 
optional processing unit 83 (shown in phantom) which can be used to manipulate the characteristics of the speech 
that is synthesised. One of the significant advantages of using the statistical analysis unit described above is 
that the model order for the AR filter model is not assumed to be constant and will vary from frame to frame. In 
this way, the optimum number of AR filter coefficients will be used to represent the speech within each frame. In 
contrast, with linear prediction analysis, the number of AR filter coefficients is assumed to be constant and hence 
the prior art techniques tend to over parameterise the speech in order to ensure that information is not lost. As a 
result, with the statistical analysis described above, the amount of data which has to be transmitted from the 
transmitter to the receiver will be less than with the prior art systems which assume a fixed size of AR filter model. 
[0077] Figure 14 shows another system which uses the statistical analysis unit 21 described above. The system 
shown in Figure 14 allows a user to add a voice annotation to a data file 91 for use in subsequent voice retrieval 
operations. In use, the user selects a data file to be annotated (which may be a photograph or the like). The user then 
speaks the voice annotation and the input speech received via the microphone 7 is processed by the statistical 
analysis unit 21 in the same way as described above, except the data analysis unit only outputs the variance (<j a 2 ) of 
the AR filter coefficients for each frame of speech which is passed to a speech quality assessor 93. The speech 
quality assessor 93 uses this variance information as an indication of the quality of the input speech (although it 
will also depend on other factors). However, in general, when the input speech is of a high quality (i.e. not 
disturbed by high levels of background noise), the variance should be small and when there are high levels of noise, 
the variance should be large. The speech quality assessor 93 then outputs to a data file annotation unit 95 a signal 



identifying whether or not the input voice annotation is of a high quality In this embodiment th* inn,,t *r~~ h ic 
2E£T" d th H rOUgh „ a tr l di,bnal SpeeCh Ve-P™**** 95 and then'to -Cia^^^^^^Si; 

un^QQ The d^Tffl^ Ph °Tr S rSP > e ^ nt .t tiVe ° f the input speech which are ,hen ^ '0 theS f«e annoteS 
unit 99. The data file annotation unit 99 then annotates the selected data file 91 with the data outout hi h» 

ffXiZSET 97 ^ ° UtPUt by thS ^ qUaHty aSS6SS0r 93 and s " he ^-notatd dafa fie 

S2T « ■ AS f tf r f 'hose skilled . in ,he art wi " appreciate, this speech quality indication which is stored with the 
data file is useful for subsequent retrieval operations. In particular, when the user wishes to retrieve a data 
.91 from the database 101 (using a voice query), it is useful to know the quality of me speech That was uSd o 

STir^'S da, f f " e , and i° r ,he qU f ty ° f the V0ice retrieval ^ used to retrieve The TJate ile s^thS 
» n 0 l? the retrieval performance. In particular if the voice annotation is of a high quality ^^and' the use?! 
retneval query ,s also of a high quality, then a stringent search of the database 101 can , be peXrmed in oraw tn 

the U u^ e r P fr mOU , nt ° f false f ide | nWiCa,i0nS - ' n COn,raSt ' « the ori 9 inal vofce an "°tatbn i S ?T bw qualrty or 
nK? e , h h T Val ^f^' 3 ° f 3 IOW quality ' then a less stringent search of the database 101 can be^ performed to 
give a higher chance of retrieving the correct data file 91 . perormea to 

[0079] In addition to using the variance of the AR filter coefficients as an indication of the speech quality 
the variance (<x e ) of the process noise is also a good measure of the quality of the input speech sincl thfe 
M^H n ?n »J?° T aSUrS °/ th ? e , nergy in the process noise - Therefore, the variance of the process noise can be 
th?? n p'Ct speech" t0 ° r ' nStead ° f ,h6 VarianCe ° f the AR ffler COeffiden,s to P™ ide 'he measure or^y of 
[0080] 



[0080] In the above embodiment, a separate preprocessor 95 was provided as the front end to the soeech 

DreXrJLrfor?^ AS ^ Ski,led in the 3,1 Wi " a PP recia t*. 'he statists analysis uS 2? may IS aTthe 
preprocessor for the speech recognition unit 97. Likewise, in the speech recognition system described above w»h 
reference to Fpure 10, the statistical analysis unit 21 may be used P solely for Sin T nformafon S the speeS 
detection unit 61 and a separate speech preprocessor may be used to parameterise the input Seech for use hWhS 
^S^^!,^^ — ~ of^he input speech ftT^STS 

3 ! ih SySt6r ? AS th °~ Se Skl " ed in the art wi " appreciate, if the speech recognition system °s dSne^ to 
ooZffiJ **] th f T Ctra ' coefric,ents . 'hen the coefficient converter 23 may be arranged to invert thl AR^Iter 
h2Sh 5 ,n, ° . the , aP ^ 0pna i e Sp8Ctral paramete rs. Alternatively still, if the speech recogSn svJteJ fe 
designed to operate with AR coefficients, then the coefficient converter 23 is unnecessary ^ 
n^Lntw l n ab ° ve embodiments, Gaussian and Inverse Gamma distributions were used to model the various orior 

P hfrSt y n d h r S ^ » n ^? nS ° f eqUa u tbn (19> As those skilled in the art of statistical analy3irw7a P pre;iate 
the reason these distributions were chosen is that they are conjugate to one another This means tha t each ^hP 
conditional probability density functions which are used in the Gib bs sampler wil ato Tfther be ^GauLan or 

tEZL ^TEnSf the f or xK irnplmeS thS t3Sk ° f drawin 9 Sam P' es from » he »n3!taJ probabiiS 
However, this is not essential. The noise probability density functions could be modelled bv LaDlacian or student i 

iTZ ??rH? her ^ ? aUSSfan distributi o^. Similarly, the probability densityTnc bns for ^£ valances mav 
rIZ^H 5 , K y f d,StnbUtl0n other than the Inverse Gamma distribution" For example, they can be modelted by a 
Snctbn, thlf ^' 0n °\ S ° me ° her ^, istribution which is always positive. However the uL of probabSity density 
^^^S^LSSS^ W '" reSU " in inCreaS6d COm P' exit V I" tawing samples frorn the XnSbS 
n^in A * m ™ a "y- whilst the Gibbs sampler was used to draw samples from the probability density function 

[0084] In the above embodiment, a Simulation Smoother was used to generate estimates for the raw soeech 

th P T5, S m J h ' S IT' 3 " 0 " Sm ° 0 ,l her indUded a Kalman filter staae and a soothing filter sTaTe in ord?r TgeSe 
the estimates of the raw speech samples. In an alternative embodiment, the smoothing filter stage mav be omS 
since the Kalman filter stage generates estimates of the raw speech (see equatton (33)) Howeve^lhTi raw soeeS 

Sid Sr^K' SinCe ^ S £T h SampleS generated b * < he smo °thing "Iter a^cSnSe^?^^^ 
and robust This .s because the Kalman filter essentially generates a point estimate of the speech ££££ from me 

SrXfSSS, fUnCt ' 0n P(§(n)la ' k ' tTe2) ' WherSaS ,he Simu,atbn Smoother draws a sa mple fromTis probTb^ 

i^i ' n the B * 0VB embodiment, a Simulation Smoother was used in order to generate estimates of the raw 
speech samples. It is possible to avoid having to estimate the raw speech samples bv treatina thTrr TL L 

w1. r h m vl e ™ n K inte9rating ° Ut ° f eqUati0n (19 >- H0Wever > ^is is nof ?eSn-ed y , ^^^53 

h!L ^ LT, m ° re C ° mpl ? X form than the Gaussian and lnverse Gamma mature defined in equafe^ g 9 ) ThilTn 
urn will result in more complex conditional probabilities corresponding to equations (20) to (30) In a Simla wav 
the other nuisance parameters (such as the coefficient variances or any of the InverJ Gamma, alphJ and E£ 



parameters) may be integrated out as well. However, again this is not preferred, since it increases the complexity 
of the density function to be sampled using the Gibbs sampler. The technique of integrating out nuisance parameters 
is well known in the field of statistical analysis and will not be described further here. 

[0086] In the above embodiment, the data analysis unit analysed the samples drawn by the Gibbs sampler by 
determining a histogram for each of the model parameters and then determining the value of the model parameter using 
a weighted average of the samples drawn by the Gibbs sampler with the weighting being dependent upon the number 
of samples in the corresponding bin. In an alterative embodiment, the value of the model parameter may be determined 
from the histogram as being the value of the model parameter having the highest count. Alternatively, a 
predetermined curve (such as a bell curve) could be fitted to the histogram in order to identify the maximum which 
best fits the histogram. 

[0087] In the above embodiment, the statistical analysis unit modelled the underlying speech production process 
with a separate speech source model (AR filter) and a channel model. Whilst this is the preferred model structure, 
the underlying speech production process may be modelled without the channel model. In this case, there is no need 
to estimate the values of the raw speech samples using a Kalman filter or the like, although this can still be done. 
However, such a model of the underlying speech production process is not preferred, since the speech model will 
inevitably represent aspects of the channel as well as the speech. Further, although the statistical analysis unit 
described above ran a model order selection routine in order to allow the model orders of the AR filter model and 
the channel model to vary, this is not essential. In particular, the model order of the AR filter model and the 
channel model may be fixed in advance, although this is not preferred since it will inevitably introduce errors into 
the representation. 

[0088] In the above embodiments, the speech that was processed was received from a user via a microphone. As 
those skilled in the art will appreciate, the speech may be received from a telephone line or may have been stored 
on a recording medium. In this case, the channel model will compensate for this so that the AR filter coefficients 
representative of the actual speech that has been spoken should not be significantly affected. 

[0089] In the above embodiments, the speech generation process was modelled as an auto-regressive (AR 
process and the channel was modelled as a moving average (MA) process. As those skilled in the art will appreciate, 
other signal models may be used. However, these models are preferred because it has been found that they suitably 
represent the speech source and the channel they are intended to model. 

[0090] In the above embodiments, during the running of the model order selection routine, a new model order was 
proposed by drawing a random variable from a predetermined Laplacian distribution function. As those skilled in the 
art will appreciate, other techniques may be used. For example the new model order may be proposed in a 
deterministic way (ie under predetermined rules), provided that the model order space is sufficiently sampled. 

Claims 

1. A speech processing apparatus comprising: 

means for receiving a set of signal values representative of a speech signal generated by a speech source 
as distorted by a transmission channel between the speech source and the receiving means; 

a memory for storing data defining a predetermined function derived from a predetermined signal model which 
includes a first part having first parameters which models said source and a second part having second 
parameters which models said channel and said function being in terms of said first and second parameters 
and in terms of a set of signal values; 

means for applying said set of received signal values to said stored function; and 

means for processing said function with those values applied to obtain values of said first parameters that 
are representative of said speech generated by said speech source before it was distorted by said 
transmission channel. 



2. An apparatus according to claim 1, wherein said function generates, for a given set of received signal values, a 
probability density function which defines, for a given set of first and second parameters, the probability that the 
predetermined signal model has those parameter values, given that the signal model is assumed to have generated 
the received set of signal values and wherein said processing means comprises means for drawing samples from 
said probability density function and means for determining said values of said first parameters that are 
representative of the speech from the drawn samples. 

3. An apparatus according to claim 2, further comprising means for evaluating said probability density function for 
the set of received signal values using one or more of said drawn samples or parameter values for different 
numbers of parameter values, to determine respective probabilities that the predetermined signal model has those 
parameter values and wherein said processing means is operable to process at least some of said drawn samples of 
parameter values and said evaluated probabilities to determine said values of said first parameters that are 
representative of the speech generated by said source before it was distorted by said transmission channel. 



4. An apparatus according to claim 2 or 3, wherein said processing means is operable to determine a histoaram 
of said drawn samples and wherein said values of said first parameters are determined from said hStogrlm 9 

5. An apparatus according to claim 4, wherein said processing means is operable to determine said values of said 
ESogram US ' n9 " ^ " *""" and Where ' n the ^ngT^^Z J frem S 

6 - l ° 5 ' Wh6rein «* ^ meanS * °P* rabte <° *™ samples 

7 - Sl^J^ttSS? C ' aimS 2 t0 6> S3id SamP " ng iS 0perabte to draw both 

8. An apparatus according to any of claims 2 to 7, wherein said sampling means comprises a Gibbs sampler. 

9 ' i^ a £S^ ac =° rdin 9 t0 anv of claims 2 to 8, wherein said processing means comprises means for analysing at 
east some of said drawn samples of parameter values to determine a measure of the variance of said samX and 
the apparatus further compnses means for outputting a signal indicative of the quality of °he recced 4t of 
signal values in dependence upon said determined variance measure. receded set of 

10 An apparatus according to claim 9, wherein said probability density function is in terms of said variance 
^mXX 6 ^ ana ' ySin9 m<?anS fe ° Perable t0 SamP ' eS ° f - VarianCe -asurf frrS 

11. An apparatus according to any preceding claim, wherein said function is in terms of a set of raw speech sianal 
values representee °f speech generated by said source before being distorted by said tranSrfeS T chlnnel 
wherein the apparatus further comprises second processing means for processing the rece sSoflhnS values 
wi h initial estimates of said first and second parameters, to generate an estimate ofTe T r?w sS stn J 
values corresponding to the received set of signal values and wherein said a PP ly?ng means iJ ™J££ to aS 
said estimated set of raw speech signal values to said function in addition to saHMtXJSS signages ^ 

12. An apparatus according to claim 1 1 , wherein said second processing means comprises a simulation smoother. 

13. An apparatus according to claim 1 1 or 12, wherein said second processing means comprises a Kalman filter. 

14. An apparatus according to any preceding claim, wherein said receiving means is operable to receive a sequence 
of sets of signal values representative of a speech signal generated by a speech source J^SZ^b^S 
transmission channel and where.n said processing means is operable to obtain values of said firsTparameters^fr 
the speech within each set of signal values in said sequence. parameters tor 

15. An apparatus according to claim 14, wherein said processing means is operable to use the values of said first 
parameters obtained during the processing of a preceding set of signal values = a!7nS estimrtes^J E 
values of said first parameters for a current set of signal values being processed. estimates for the 

16 ' ovt5appi P nr tUS aCC ° rdin9 '° ^ " " ^ Wher6in ^ *** °' ^ ^ * SaW sw ' uence are non " 

17 An apparatus according to any of claims 14 to 16, wherein said processing means comprises means for varvina 
the number of parameter values used to represent the speech signal within each set of signage™ ^ 9 

18 An apparatus according to any preceding claim, wherein said first part is an auto-regressive model and said 
first parameters comprise auto-regressive model coefficients. 'eye^ive moaei ana saw 

19 " JS a 4 PP aratus , accordin 9 t0 an V preceding claim, wherein said second part is a moving average model and said 
second parameters compnse moving average model coefficients. 

20. An apparatus according to any preceding claim, further comprising means for comparing said determined 
parameter values wrth pre-stored parameter values to generate a comparison result. determmed 

21 An apparatus according to any of claims 1 to 19. further comprising recognition means for comoarina said 
determined parameter values with pre-stored reference models to generate a recognition result C ° mpanng ^ 

22. An apparatus according to any of claims 1 to 19. further comprising speaker verification means for comparing 



said determined parameter values with pre-stored speaker models to generate a verification result. 

23. A speech processing method comprising the steps of: 

receiving a set of signaJ values representative of a speech signal generated by a speech source as modified 
by a transmission channel between the speech source and the receiver; 

storing data defining a predetermined function derived from a predetermined signal model which includes a 
first part having first parameters which models said source and a second part having second parameters 
which models said channel, said function being in terms of said first and second parameters and generating, 
for a given set of signal values, a probability density function which defines, for a given set of first 
parameters and second parameters, the probability that the predetermined signal model has those parameter 
values, given that the signal model is assumed to have generated the received set of signal values; 

applying said set of received signal values to said function; 

processing said function with those values applied to derive samples of at least said first parameters from 
said probability density function; and 

means for analysing at least some of said derived samples to determine values of said first parameters that 
are representative of said speech signal generated by said source before it was modified by said 
transmission channel. 



24. A method according to claim 23, wherein said function generates, for a given set of received signal values, a 
probability density function which defines, for a given set of first and second parameters, the probability that 
the predetermined signal model has those parameter values, given that the signal model is assumed to have 
generated the received set of signal values and wherein said processing step comprises the steps of drawing 
samples from said probability density function and determining said values of said first parameters that are 
representative of the speech from the drawn samples. 

25. A method according to claim 24, further comprising the step of evaluating said probability density function 
for the set of received signal values using one or more of said drawn samples or parameter values for different 
numbers of parameter values, to determine respective probabilities that the predetermined signal model has those 
parameter values and wherein said processing step processes at least some of said drawn samples of parameter 
values and said evaluated probabilities to determine said values of said first parameters that are 
representative of the speech generated by said source before it was distorted by said transmission channel. 

26. A method according to claim 24 or 25, wherein said processing step determines a histogram of said drawn 
samples and wherein said values of said first parameters are determined from said histogram. 

27. A method according to claim 26, wherein said processing step determines said values of said first parameters 
using a weighted sum of said drawn samples, and wherein the weighting is determined from said histogram. 

28. A method according to any of claims 29 to 27, wherein, said sampling step draws samples iteratively from said 
probability density function. 

29. A method according to any of claims 24 to 28, wherein said sampling step draws samples of both said first and 
second parameters. 

30. A method according to any of claims 24 to 29, wherein said sampling step uses a Gibbs sampling technique. 

31. A method according to any of claims 24 to 30, wherein said processing step comprises the step of analysing at 
least some of said drawn samples of parameter values to determine a measure of the variance of said samples and 
wherein the method* further comprises the step of outputting a signal indicative of the quality of the received 
set of signal values in dependence upon said determined variance measure. 

32. A method according to claim 31, wherein said probability density function is in terms of said variance measure 
and wherein said analysing step draws samples of said variance measure from said probability density function. 

33. A method according to any of claims 23 to 32, wherein said function is in terms of a set of raw speech signal 
values representative of speech generated by said source before being distorted by said transmission channel, 
wherein the method further comprises a second processing step of processing the received set of signal values 
with initial estimates of said first and second parameters, to generate an estimate of the raw speech signal 



values corresponding to the received set of signal values and wherein said applying step applies said estimated 
set of raw speech s.gnal values to said function in addition to said set of received signal values. estimated 

34. A method according to claim 33, wherein said second processing step uses a simulation smoother. 

35. A method according to claim 23 or 34, wherein said second processing step uses a Kalman filter. 

36. A method according to any of claims 23 to 35, wherein said receiving step receives a sequence of sets of 
signal values representat^e of a speech signal generated by a speech source as distorted by saW transrSon 

^R^^SST" StSP ° btainS ValUSS ° f «* fet P arameters for < he sP^h within^rS 

37 'H,Snn et .h° d according t0 ? aim 36 ' wherein **« Processing step uses the values of said first parameters obtained 
™J« % P rocessing of a Riding ^t of signal values as initial estimates for the values o iid fiS 
parameters for a current set of signal values being processed. 

38. A method according to claim 36 or 37, wherein said sets of signal values in said sequence are non-overlapping. 

39 'n,^£Tr!^ acCor ? Jing to any of ^ laims 36 to 38 - wherein said processing step comprises the step of varying the 
number of parameter values used to represent the speech signal within each set of signal values. 

4 \ri n^l hOC l aCCOrding . t0 anv of claims 23 t0 39 - wherein said first part is an auto aggressive model and said 
first parameters comprise auto aggressive model coefficients. 

41 'J^nH th0d ac ? ording t0 anv of claims 23 to 40 - wherein said second part is a moving average model and said 
second parameters comprise moving average model coefficients. . a= ana saw 

42. A method according to any of claims 23 to 41, further comprising the step of comparing said determined 
parameter values with pre-stored parameter values to generate a comparison result. COmpanng Sa ' d determlned 

43. A method according to any of claims 23 to 41, further comprising the step of comparing said determined 
parameter values w,th pre-stored reference models to generate a recognition result determined 

^'detrmt^n^ 0 ^" 9 ^ °L daimS 23 ,0 41 ' further ""V**** speaker verification means for comparing said 
determined parameter values with pre-stored speaker models to generate a verification result. 

45. A speech processing apparatus comprising: 

meanS ^° r JT eiV 4 ing 3 361 ° f Signal Values representative of a speech signal generated by a speech source 
as modrfied by a transmission channel between the speech source and the receding means? 

fndud^ tf K 3 * 3 d 1- ni r 9 3 P red , etermir, ed function derived from a predetermined signal model which 
nfr^ k £ rt IfT 9 5* P arameters which models said source and a second part having second 
EES ™ 7 h m ° delS &aid , channel ' faction being in terms of said first and second parameter and 
Ttof™£LfL 9Ne « ** °L S ' gnal V f' UeS ' 3 P rababilit y de nsity function which defines, for a gS set 
of first parameters and second parameters, the probability that the predetermined signal model hastho^e 
parameter values, g^en that the signal model is assumed to have generated the receiveSoTsignal ^Values- 
means for applying said set of received signal values to said function; 

sss^d^ix^ values applied to derK/e samples of at ieast said first parameters fr ° m 

means for analysing at least some of said derived samples to determine values of said first parameters that 

46. A speech processing apparatus comprising: 

mean f L 0r ^ reCeiV i n9 3 361 ° f Signal values representative of a speech signal generated by a speech source 
as d.storted by a transmission channel between the speech source and the receiving means, 

a memory for storing data defining a predetermined function derived from a predetermined signal model 



which includes a first part having first parameters which models said source and a second part having 
second parameters which models said channel, said function being in terms of said first and second 
parameters and being in terms of a set of raw speech signal vaJues representative of speech generated by 
said source before being distorted by said transmission channel; 

means for processing said received set of signal values with initial estimates of said first and second 
parameters, to generate an estimate of the raw speech signal values corresponding to the received set of 
signal values; 

means for applying said set of received signal values and the estimated set of raw speech signal values to 
said function; 

means for processing said function with those values applied to obtain values of said first parameters that 
are representative of said speech signal generated by said speech source before it was distorted by said 
transmission channel. 



20 



47. A speech processing apparatus comprising: 

15 

means for receiving a set of signal values representative of a speech signal generated by a speech source 
as modified by a transmission channel between the signal source and the receiving means; 

a memory for storing data defining a predetermined function derived from a predetermined signal model which 
includes a first part having first parameters which models said source and a second part having second 
parameters which models said channel, said function being in terms of said first and second parameters and 
being in terms of a set of raw speech signal values representative of a speech signal generated by said 
source before being modified by said transmission channel, said function generating, for a given set of 
signal values, a probability density function which defines, for a given set of first parameters, second 
parameters and raw speech signal values, the probability that the predetermined signal model has those 
25 parameter values and generates said raw speech signal values, given that the signal model is assumed to 

have generated the received set of signal values; 

means for processing said received set of signal values with initial estimates of said first and second 
parameters, to generate an estimate of said set of raw speech signal values corresponding to the received 
set of signal values; 

30 

means for applying said set of received signal values and the estimated set of raw speech signal values to 
said function; 

means for processing said function with those values applied to derive samples of at least said first 
35 parameters from said probability density function; and 

means for analysing at least some of said derived samples to determine values of said first parameters that 
are representative of said speech signal generated by said speech source before it was modified by said 
transmission channel. 

40 

48. An apparatus for determining sets of parameter values representative of an input speech signal, the apparatus 
comprising: 

means for receiving a plurality of speech signal values representative of an input speech signal; 

means for dividing the plurality of speech signal values into a succession of groups of speech signal values; and 

means for determining a set of parameter values representative of the speech signal values in each group; 

wherein said determining means comprises means for varying the number of parameter values used to 
5 0 represent the speech signal values in each group. 

49. An apparatus for determining sets of parameter values representative of an input speech signal, the apparatus 
comprising: 



45 



55 



means for receiving a plurality of speech signal values representative of an input speech signal; 

means for dividing the plurality of speech signal values into a succession of groups of speech signal values; and 



means for processing the speech signal values in each group to determine a set of parameter values 
representative of the speech signal values in the group; 

wherein said processing means comprises: 

a memory for storing data defining a predetermined function which gives, for a set of speech signal 
values of a group, a probability density for parameters of a predetermined signal model which is 
assumed to have generated the speech signal values in the group, the probability density defining, for 
a given set of parameter values, the probability that the predetermined signal mode! has those 
parameter values, given that the model is assumed to have generated the speech signal values in the 
group; 

means for applying the set of speech signal values of a current group to said stored function to give 
the probability density for said model parameters for the current group; 

means for processing said function to derive samples of parameter values from said probability density 
for the current group; 

means for evaluating said probability density for the current group using one or more of said derived 
samples of parameter values for different numbers of parameter values to determine respective 
probabilities that the predetermined signal model has those parameter values; and 

means for processing at least some of said derived samples of parameter values and said evaluated 
probabilities to determine model parameters that are representative of the set of signal values in the 
current group. 



50. An audio comparison apparatus comprising: 

a memory for storing a predetermined function which gives, for a given set of audio signal values, a 
probability density for parameters of a predetermined audio model which is assumed to have generated the 
set of audio signal values, the probability density defining, for a given set of model parameter values, 
the probability that the predetermined audio model has those parameter values, given that the model is 
assumed to have generated the set of audio signal values; 

means for receiving a set of audio signal values representative of an input audio signal; 

means for applying the set of received audio signal values to said stored function to give the probability 
density for said model parameters for the set of received audio signal values; 

means for processing said function, with said set of received audio signal values applied, to derive 
samples of parameter values from said probability density; 

means for analysing at least some of said derived samples of parameter values to determine parameter values 
that are representative of the set of received audio signal values; and 

means for comparing said determined parameter values with pre-stored parameter values to generate a 
comparison result. 



51 . A speech recognition system comprising an audio comparison apparatus according to claim 50. 

52. A speaker verification system comprising an audio comparison apparatus according to claim 50. 

53. An acoustic classification system comprising an audio comparison apparatus according to claim 50. 

54. An audio processing system substantially as hereinbefore described with reference to or as shown in the 
accompanying drawings. 

55. An audio processing method substantially as herein above described with reference to or as shown in the 
accompanying drawings. 



56. A computer readable medium storing computer executable process steps to cause a programmable computer 
apparatus to perform the method of any of claims 23 to 44. 

57. Processor implementable process steps for causing a programmable computing device to perform the method 
according to any of claims 23 to 44. 
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